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This article reexamines the notion of closed-loop carrier phase synchronization 
motivated by the theory of maximum a posteriori phase estimation with emphasis on 
the development of new structures based on both maximum-likelihood and average- 
likelihood functions. The criterion of performance used for comparison of all the 
closed-loop structures discussed is the mean-squared phase error for a fixed-loop 
bandwidth. 


I. Introduction 

It is well known [1] that estimation of an unknown parameter based on a likelihood function approach 
is optimum in the sense of maximizing the a posteriori probability of the parameter given the observation. 
For the case where the unknown parameter is the random phase of a carrier received in a background 
of additive white Gaussian noise (AWGN), optimum open-loop structures have been derived for imple- 
menting the resulting phase estimate [2,3]. Herein, these structures are referred to as “open-loop carrier 
phase estimators.” 


When the carrier is data modulated, the conditional probability density function (pdf) of the 
observation— given the carrier phase— depends on the data sequence that exists during the interval of 
observation for the received signal. Hence, before maximizing this function with respect to the carrier 
phase, one has to choose how to eliminate its dependence on the unknown data sequence. If one is inter- 
ested in determining only the optimum carrier phase estimate, the appropriate choice is to average the 
conditional pdf over the unknown data sequence. We shall refer to the phase estimate obtained by this 
process as the “average-likelihood” (AL) estimate. If, however, one is interested in joint phase estimation 
and data detection, the appropriate choice is to first maximize the conditional pdf with respect to the 
data sequence (resulting in the most probable sequence), and then to maximize it with respect to the 
carrier phase. We shall refer to the phase estimate obtained by this process as the “maximum-likelihood” 


1 In principle, the order of maximization 


operations could be reversed. 
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(ML) estimate. 2 It has often been conjectured, although never proven, that from the standpoint of phase 
estimation alone, the ML phase estimate is suboptimum to the AL estimate. Because of this, what is 
typically done in practice is to derive the AL carrier phase estimate and then use this estimate as the 
phase of a demodulation reference signal for performing bit-by-bit data detection. However, it should 
be understood that, from the standpoint of joint estimation of data and carrier phase, this sequential 
operation of first deriving the carrier phase estimate in the absence of any knowledge of the data (the 
AL approach) and then detecting the ensuing data using the phase estimate so derived is, in general, 
suboptimum. 

Aside from the optimality of the AL and ML approaches to open-loop estimation of carrier phase, 
likelihood functions have also been used as motivation for closed-loop carrier phase synchronization. 
Emphasis is placed on the word “motivation” since, indeed, there is no guarantee that the resulting 
closed-loop schemes are optimal; nor can one guarantee that those schemes motivated by the AL approach 
will outperform those motivated by the ML approach (although typically this turns out to be the case, 
as we shall show.) Nonetheless, as we shall see, closed-loop carrier phase estimation schemes motivated 
by likelihood functions do indeed yield good tracking performance (as measured by the mean-squared 
value of the loop phase error). In fact, under suitable assumptions, many of them are synonymous with 
well-known carrier tracking loops, e.g., the I-Q Costas loop and the I-Q decision feedback or polarity-type 
Costas loop [4,5] that have been around for many decades. 

It is the intent of this article to explore in more detail the structure and performance of closed-loop 
carrier phase synchronization loops motivated by likelihood functions, i.e., those in which the derivative 
(or some monotonic function of the derivative) of the conditional pdf of the observation given the carrier 
phase is used as an error signal in a closed-loop phase estimation scheme. Herein, for the purpose of 
abbreviated notation, we shall refer to such loops as AL and ML closed loops depending on the particular 
likelihood function used to define the error signal. 

It is important at this point to mention that the notion of closed loops based on likelihood functions 
according to the above definition is indeed not new, and one should not attribute its originality to the 
authors of this article. Rather, the purpose of this article is to expand upon this notion and present 
some new loops motivated by likelihood functions along with their tracking performances. As such, 
we are not reinventing the wheel but, rather, adding some more spokes to it. Our specific motivation 
for reexamining this problem comes from a deep-space communication application involving the Galileo 
S-band (2.3 GHz) mission, which employs low-rate (r = 1/4) concatenated Reed— Solomon/convolutionally 
encoded binary phase-shift keying (BPSK) [6]. Because of a malfunctioning high-gain X-band (8.4 GHz) 
antenna, the mission must rely on a low-gain S-band antenna (and, thus, much reduced link margin) for 
data transmission back to Earth. At Jupiter encounter, the symbol energy-to-noise spectral density ratio, 
E s /N 0 , could be as low as —11 dB. One technique for improving this situation is to use antenna array 
combining [7] wherein the signals from multiple antennas, either collocated or at distant geographical 
locations, are combined to build E s /N 0 . Even then the equivalent E s /N 0 could still be as low as -5 dB. 
Thus, in our application, there is a serious need to find as efficient a carrier tracking loop as possible 
in the sense of producing minimum phase jitter at very low E 3 /N 0 . In the more general context, it is 
important to point out that, in coded systems, the carrier-loop performance is dependent on the symbol 
energy-to-noise ratio E s /Nq rather than the bit energy-to-noise ratio E^/Nq and, thus, becomes critical 
when E s /Nq becomes small, despite the fact that E^/Nq might be large. In uncoded systems where 
Es/Nq — E}j/Nq and is large, the search for a more efficient carrier tracking loop is somewhat academic 
since the known configurations perform quite well and are virtually identical to one another. 


In the strictest of parlance, both the AL and the ML phase estimates are maximum-likelihood estimates since the term 
maximum-likelihood estimation” is typically reserved for estimating a purely unknown (uniformly distributed) random 
parameter. However, to allow for distinguishing between the two different ways in which the data sequence is handled, 
we shall use the above terminology. 
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The hierarchical structure of the problem and also the way in which it is addressed in this article is 
illustrated by the tree diagram of Fig. 1. We have already discussed the first level of the overall dichotomy 
in terms of the ML and AL approaches. This level of the chart as well as those below it will take on more 
meaning as soon as we develop a mathematical formulation of the problem in Section III. 



i-Q MAP i-q polarity-type 

ESTIMATION LOOP COSTAS LOOP 


EACH OF THE 0 ESTIMATORS HAS TWO FORMS DEPENDING ON WHETHER 
THE L - SYMBOL OBSERVATION IS TAKEN AS A WHOLE OR PARTITIONED INTO 
/.-INDEPENDENT SYMBOL INTERVALS, EACH OF DURATION 7 sec 


Fig. 1 . A hierarchical structure of the open-/closed-loop carrier phase estimation problem for data-modulated signals. 


II. System Model 

Consider a system that transmits BPSK 3 modulation over an AWGN channel. As such, the received 
signal takes the form 


r(t) = V2Sd(t) sin (u c t + 9) + n(t) = s (t; 9, d(t )) + n(t) 


( 1 ) 


where S denotes the received power, w c is the carrier frequency in rad/sec, 6 is the unknown phase 
assumed to be uniformly distributed in the interval (-7r,7r), n(t) is an AWGN with single-sided power 


3 We restrict ourselves to the case of binary modulation. By a straightforward extension of the procedures discussed, the 
results can easily be extended to M-ary modulation. 
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spectral density No W/Hz, and d(t ) is a binary- valued (±1) random pulse train defined by the rate 1/T 
binary data sequence {di} and the rectangular pulse shape, p(t), as 


OO 

d{t) = Y. - iT ). 

— OO 



0 <t<T 
otherwise 


( 2 ) 


For an observation interval of L bits [we assume without loss of generality the interval (0 ,LT)\, the 
conditional pdf of the received signal (observation) given the unknown phase and the particular data 
sequence, di, transmitted in that interval is easily shown to be 

( 2V2S r LT \ 

p(r(t)\9,di(t)) = Co exp ( j r(t)di(t) sin (u> c t + 9)dt J =^(9) (3) 

where di(t) is the transmitted waveform corresponding to the transmitted sequence in accordance with 
Eq. (2) and Cq is a constant of proportionality. To proceed further, we must now choose between AL and 
ML approaches. 


III. Closed Loops Motivated by the AL Approach 

A. Structures 

Suppose that we are interested in estimating only the carrier phase, 9. Then, as previously mentioned, 
the appropriate approach is to average p(r(t)\6,di(t)) over all possible (2 L ) and equally likely data 
sequences yielding the conditional pdf p(r(t)\9) = q A L{B). One AL open-loop phase estimate (herein 
referred to as “AL open-loop estimator no. 1”) is obtained by finding the value of 9 that maximizes 
Qal(0), namely (see Fig. 1: §al = max^ 1 qAL{Q), unpartitioned observation) 


2 l 

9ali = max -1 ^ exp 

i=l 


f 2V2 s 

V No 


rLT 

Jo 


r(t)di sin (u c t + 9)dt 


(4) 


where the inverse maximum notation “max 1 / (9)” denotes the value of 9 that maximizes f(9). Alter- 
nately, breaking up the integration over the entire observation into a sum of integrals on each bit interval 
and recognizing that the data bits are independent, identically distributed (iid) binary random variables, 
then p (r(t)\9) can be expressed as a product of hyperbolic cosine functions. A second AL open-loop 
phase estimate (herein referred to as “AL open-loop estimator no. 2”) is obtained by finding the value of 
9 that maximizes this product form of Qal{9), which corresponds to partitioning the observation into its 
individual bit intervals. The result is (see Fig. 1 : 9 AL = maxg 1 Qal(9), partitioned observation) 


7 al 2 — m ax 
e 


tr 1 , (2V2S f^ T 

11 cosh sin c* + 9)dt 

k = 0 V 0 ^ kT 


(5) 


It is important to emphasize here (and we shall repeat this emphasis later on in the closed-loop dis- 
cussion) that partitioning or not partitioning the observation interval has no effect on the value of the 
optimum estimator nor on its performance. That is, optimum open-loop 9 A l 1 and 9 AL2 are mathe- 
matically identical. The difference between the two lies solely in their implementation and likewise the 
difference in the closed-loop implementations motivated by these estimates, as we shall see shortly. 



Finally, one could obtain an AL open-loop estimator by maximizing any monotonic function of <7 al( 0), 
for example In q AL (0). The reason for choosing the natural logarithm as the monotonic function is to 
simplify the mathematics, i.e., to convert the L-fold product in Eq. (5) to an L-fold sum. Thus, the 
third AL open-loop phase estimate (herein referred to as “AL open-loop estimator no. 3”) is obtained by 
finding the value of 6 that maximizes ln^ L (0) with q AL (0 ) in its partitioned form. The result is (see 
Fig. 1: 6al ~ max^ln Qal(9), partitioned observation) 


L - 1 

9al 3 — max -1 ^ In cosh 
A :=0 


2V2 s /- (A:+1)T 

No JkT 


r(t) sin {u) c t + 6)dt 


( 6 ) 


Block diagram implementations of AL open-loop estimator no. 1 [Eq. (4)] and AL open-loop estimator 
no. 3 [Eq. (6)] are illustrated in Fig. 2, no. 3 being the form most commonly found in discussions of 
open-loop maximum a posteriori (MAP) carrier phase estimation. In drawing these implementations, we 
have quantized the unknown phase into Q values, and thus the maximization over the continuous phase 
parameter 9 in Eqs. (4) and (6) is approximated by maximization over a Q-quantized version of this 
parameter. 



Fig. 2 . Implementation of two AL open-loop phase estimators: (a) AL open-loop estimator no. 1 — observation 
unpartitioned (quantized parallel implementation) and (b) AL open-loop estimator no. 3 — observation partitioned 
(quantized parallel implementation). 


Conceptually, a fourth optimum AL open-loop estimator, Qal 4 i could be obtained by maximizing 
In q A L(9) with q A L(0) in its unpartitioned form. However, in view of the above discussion, §al 3 and § A l 4 
would be mathematically identical and, since §al 4 appears to have no implementation advantage, we do 
not pursue it here. 
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Closed-loop phase synchronization structures 4 based on the four AL open-loop estimators are obtained 
by choosing as error signals, e, the functions respectively given by dq AL (d)fdd and d\nq AL (d)/d9 where 
Qal(9) an d In q A i , ($) each takes on its unpartitioned or partitioned form. For simplicity of notation, we 
shall refer to these four closed-loop structures as AL closed-loop nos. 1, 2, 3 and 4. The implementations 
corresponding to AL closed-loop no. 1 and AL 61osed-loop no. 3 (the two simplest implementations of 
the four) are illustrated in Figs. 3(a) and (b), the latter being what is commonly called an “I-Q MAP 
estimation loop [8,9]. The special cases of Fig. 3(b), wherein the hyperbolic tangent nonlinearity is 
approximated by linear and hard limiter devices, corresponding respectively to low and high signal-to- 
noise ratio (SNR) conditions, are commonly called the “I-Q Costas loop” [4] and “I-Q polarity-type Costas 
loop” [5]. 



TO LOOP 
FILTER 



Fig. 3. Implementation of two AL closed loops: (a) AL closed loop no. 1 — observation unpartitioned and (b) AL 

closed loop no. 3 — observation partitioned. 


4 For ease of illustration, we show only the portion of the closed loop that generates the loop error signal, which in the 
actual implementation becomes the input to the loop filter. 
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Before proceeding, it is important to reemphasize that because of the monotonicity of the logarithm 
function, the AL open-loop phase estimates §al 3 and 6al a are mathematically identical to §al x and §al 2 
and thus yield identical performance. However, the equivalent statement is not necessarily true when 
considering the performances of the closed loops motivated by these four different AL formulations. More 
specifically, the closed loops motivated by Qal 3 and Oal 4 do not necessarily yield the same performance 
as those motivated by 0 A l x and §al 2 • The reason for this stems from the fact that the closed-loop 
performance (when properly normalized) is proportional to the derivative of g AL (0) (or lng AL (0) as 
appropriate) in the neighborhood of its maximum, which in general is different for g AL (0 ) and In q A L{&). 
However, we hasten to add that since partitioning does not change the functions g^ L (0) or In g AL (0) 
themselves, the closed loops derived from either the partitioned or unpartitioned forms of the likelihood 
(or log likelihood) function should yield identical performance, i.e., AL closed-loop no. 1 and AL closed- 
loop no. 2 will have identical performance, as will AL closed-loop no. 3 and AL closed-loop no. 4. 

B. Performance 

fn assessing the performance of one closed-loop scheme versus another, one must be careful to normalize 
the loop parameters to allow a fair basis of comparison. In this article, the comparison will be made on 
the basis of mean-squared phase error, for a fixed-loop bandwidth, B L . b This is the typical measure 
of performance used to describe a closed-loop phase synchronization structure when it is operating in its 
tracking mode. 

An analysis of the closed-loop performance of AL closed-loop no. 1 [Fig. 3(a)] results in an expression 
for the mean-squared phase error given by 6 


where 


and 


with 


1 T JA=i i Dij exp {2^(L + Di -f Dj + Dij )} A \ 
9 _ Em=o (m) ( L - 2m ) ex P { R d{3L - 4m)} pS 


S 

N 0 B l ’ 



L—l L - 1 

Di ^ d/cdik, } ^ dikdjk 
k — 0 fc=0 


( 7 ) 


( 8 ) 


( 9 ) 


d — (do, di, • • ■ ,dL-i) = transmitted data sequence 


di = (diQ, dn, • • • ,di t L-i) = zth data sequence; i = 1, 2, • • ■ , 2 L (10) 

5 It is important at this point to emphasize that B L , being proportional to the total loop gain, includes the slope of the loop 
S-curve at the origin as one of its factors. Since, in general, this slope is different for the various loops being investigated, 
it is absolutely essential to include this normalization (as we have done) in the definition of B L when comparing the 
performance of these loops. 

6 All of the performance results given in this article will be based upon the so-called “linear theory” [3], which assumes that 
the loop operates in a region of high loop SNR. 
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n Eq. (9), D t represents the correlation of the zth data sequence with the transmitted sequence and D ■ 
represents the correlation between the zth and the jth data sequences. Some properties of D t and D° 
that are particularly useful in obtaining many of the results that follow are summarized as 


2 l 2 l 


EE d « = ° 


2 l 2 l 2 l 2 l 
^2 ^2 D i D ij = 2222 D J D ij = 0 

i=l j=l j-i 

EE £l « = 2iE 2m ) 2 = 22Li 

i=lj=l m=0 

2 l 2 l 

E E D * D i D H = 2 2L L 

i— 1 i=l 


( 11 ) 


The factor <S L represents the loss of the effective loop SNR, p' £ <j^\ relative to the loop SNR, p, of a 
phase-locked loop (PLL). For certain configurations, as we shall see, this loss is synonymous with what 
is commonly referred to as “squaring loss” [4,10]. 

At first glance, it might appear that, for given values of p, Rj, and the observation length, L, the mean- 
squared phase error would be a function of the particular sequence chosen as the transmitted sequence. 
It is easy to show that indeed this is not the case, i.e., is independent of the sequence selected for d . 7 

To see this, consider a sequence d, = (dio,d n , • • • , d L> L _x) ± d and rewrite A and D tJ as 

L-l L—l 

^ ^ d k dikdik dik = ^ ^ dfcd'ik 
k=0 ^ 7 ^ k=0 

L-l L-l 

D ij = d ikdikdikd jk = d' ik d' jk (12) 

0 _ x fc=0 


where d' k - d k d ik represents the kth element of some other possible transmitted sequence d' = 
(«o ,d u - • ■ ,d' L _ x ) and d' ik = dikd ik ,d' jk = di k d jk are the kth elements of two other possible sequences 

d i ~ ( d 'io, d'x, • • • , d' i L _ 1 ) and d' = ( d' j0 , rfjx, — , d', L _x), respectively. Since, in general, d' ^ d and since 
the summations on i and j in Eq. (7) range over all possible (2 L ) sequences, then substitution of Eq. (9) 

into Eq. (7) shows that a ^ evaluated for a transmitted sequence equal to d' is identical to that evaluated 
tor a transmitted sequence equal to d. 


Special cases of Eq. (7) corresponding to L = 1, 2, and 3 are given below: 


ln the evaluation of Ec l- ( 7 )> we ma y choose the all-l’s sequence for d, in which case D, simplifies to 
Z^fc= o which takes on values of L - 2m, m = 0, 1, 2, • • • , L. 
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I L — 1 



e 8 Rd — 1 
(g3 Rd — g ~Rd^ 2 


a 


2 

4> 


1 

P 


e 16Rd + 2e 8Rd - 3 

( e 6i?d _ e - 2R d) 2 ’ 


L — 2 



e 2AR d _j_ g g 16 i?d _|_ 3g8/? d _ g 
^g^-^d g 5Rd — & R d g — 3 Rd'j*^ 


( 13 ) 


Figure 4 is a plot of S L (in dB) versus R d (in dB) corresponding to the three cases in Eq. (13). We 
observe that the performance of AL closed-loop no. 1 as implemented in Fig. 3(a) is clearly a function of 
the observation length of the corresponding open-loop estimator that motivated the structure. 



Fig. 4. Squaring-loss performance of AL closed-loop no. 1 with observation length L as a parameter. I&D 
weighting coefficients as determined by MAP estimation theory. 


For large R d , it is straightforward to show that crj has the asymptotic behavior 


ai S ~e 2LRd 
9 P 


-» S L = e~ 2LRd 


(14) 


For small Rd, has the asymptotic form 




S L = 2 R d 


(15) 


which is independent of L. 
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Looking at Eq. (14) and Fig. 4, one gets the impression (and rightfully so) that the mean-squared 
phase error of AL closed-loop no. 1 becomes unbounded as R d -> oo. This singular behavior can be 
traced to the fact that the 2\/2S/Nq weighting coefficient of the two integrate-and-dump (I&D) circuits 
in the closed loop of Fig. 3(a) becomes unbounded as R d -> oo(iVo -> 0). Suppose instead that we were to 
replace this coefficient by an arbitrary constant, shy Kq. From the standpoint of open-loop estimation of 
6, AL open-loop estimator no. 1 of Eq. (4) with 2y/2S /Nq now replaced by Kq would remain unchanged. 
That is, the choice of the weighting constant preceding the L-bit integration has no effect on the open-loop 
estimate. On the other hand, the choice of this weighting coefficient for the closed-loop scheme has a 
very definite bearing on its performance. In particular, with 2\f2S/N 0 replaced by Kq in Fig. 3(a), the 
mean-squared phase error, previously given by Eq. (7), now becomes 


2 1 

L Ztl £j=i Da exp [K (D t + ?;) + * 2 (jfe) ( 1 + %) }’ 

A 1 

* p 


ELo (m) (£ - 2m) exp | AT(L - 2m) + K 2 (^fc)}] 

pSl 


where we have further normalized the weighting coefficient as K = K 0 T. Note that if we set 

K 0 = 2V2S/N 0 as before, then K = 2 R d and Eq. (16) reduces to Eq. (7). 

From Eq. (16), we see that as long as K 0 (or equivalently K) is finite (which would be the case in 
a practical implementation of the AL closed-loop scheme), the large SNR asymptotic behavior of AL 
closed- loop no. 1 now becomes 


lim 

Rd—* oo 



lim 

N o ->0 


N q B l 

S 


L £«= i £j 2 =i D%j exp {K(Di + Dj )} 


_ £m=o (m) ( L ~ 2m ) ex PW£ - 2m)} 

2 


= 0 


(17) 


which is what one would expect. What is interesting is that, for any value of R d , the value of K that 
minimizes Eq. (16), which, from the standpoint of closed-loop performance as measured by mean-squared 
phase error, would be considered optimum, is K -» 0, independent of R d . In fact, if one takes the limit 
of Eq. (16) as K -> 0 [this must be done carefully using the properties in Eq. (11)], the following result 
is obtained: 


lim <j\ 
K -> o * 


A 


= \ 


1 + 


P l 2R<iJ 


(-St), 


1 2 R d 

1 + (1/2 R d ) 1 + 2 R d 


(18) 


Interestingly enough, the result in Eq. (18), which is now independent of L , is also characteristic of 
the performance of the I-Q Costas loop [4], which is obtained as a low SNR approximation to AL closed- 
loop no. 3. It is important to understand that the optimum closed-loop performance of Eq. (18) is a 
consequence of optimizing the weight (gain) K for each value of L. If instead of doing this, one were 
to fix the gain K for all values of L (as suggested by the MAP estimation approach), the closed-loop 
performance (as measured by crj with fixed-loop bandwidth) is suboptimum and indeed depends once 
again on L. One final note is that the small SNR behavior of Eq. (18) is identical to that of Eq. (15), 
the reason being that the value of K — 2 R d used in arriving at Eq. (15) approaches the optimum value 
(K = 0) as R d — > 0. 

As previously stated, the performance of AL closed-loop no. 2 is identical to that of AL closed-loop 
no. 1, and thus no further discussion is necessary. The performance of AL closed-loop no. 3 (and also 


92 



AL closed-loop no. 4) has been obtained previously [8]. In particular, the mean-squared phase error 
performance of this loop is given by 


( 7 , 


2 

<t> 


1 

P 


tanh 2 {2i?d - y/2 B~tX} 


tanh{2f? rf - v / 2#dX}| 


A J_ 
pSh 


(19) 


where AT is a zero-mean, unit-variance Gaussian random variable, and the over bar denotes statistical 
averaging over X. A plot of Si versus R d is superimposed on the curves of Fig. 4. We first note that 
the performance as given by Eq. (18) is independent of L. Furthermore, a comparison of the squaring 
loss as determined from Eq. (18) with that calculated from Eq. (17) reveals that the performance of AL 
closed-loop no. 3 is superior to that of AL closed-loop no. 1 with optimized gain for all values of Rd (see 
Fig. 3 of [8]). As mentioned previously, if the hyperbolic tangent nonlinearity in Fig. 3(b) is approximated 
by a linear device (i.e., tanhx = x), then the two loops have the same performance. 

What is particularly interesting for AL closed-loop no. 3 is that even though the performance in Eq. (19) 
is computed assuming a weighting coefficient in front of the I&Ds in Fig. 3(b) equal to 2y/ts/N Q , the 
behavior of this loop is not singular in the limit as R d —> oo. Furthermore, it is natural to ask whether 
the above weighting coefficient is indeed optimum in the sense of minimizing aj. To answer this question, 
we proceed as we did for AL closed-loop no. 1 , namely, we replace the weighting coefficient 2\/2S / Nq by 
an arbitrary constant, say Kq , and proceed to optimize the performance with respect to the choice of this 
gain. 8 Making this replacement produces a mean-squared phase error, analogous to Eq. (19), given by 


tnnh 2 {K[2R d - y/2R d X}} 

A 1 

ta,nh{K[2R d - y/2 R d X ] } 

pSl 


( 20 ) 


where, as before, we have further normalized the weighting coefficient as K = K 0 N 0 /2\/2S. Maximizing 
the squaring loss factor S L (i.e., minimizing a J) in Eq. (20) results in K = 1 (K 0 = 2s/2S/Nq) for all values 
of R d . Thus, for AL closed-loop no. 3, the optimum gain from the standpoint of closed-loop performance is 
precisely that dictated by the open-loop MAP estimation of 9 , and the best performance is that described 
by Eq. (19). 


We conclude our discussion of AL closed loops by pointing out that, in view of the superiority of 
Eq. (19) over Eq. (18), AL closed-loop no. 3 outperforms AL closed-loop no. 1 for all values of R d . 


IV. Closed Loops Motivated by the ML Approach 

A. Structures 

The ML approach to estimating the carrier phase, 0 , is to maximize (rather than to average) 
p(r(t)\di(t ), 9) over all possible ( 2 L ) and equally likely data sequences. Analogous to AL open-loop estima- 
tor no. 1, “ML open-loop estimator no. 1” is defined by (see Fig. 1: 9 M l = max. 1 unpartitioned 

observation) 


8 Again we note that this replacement does not affect the open-loop estimation of 6 using Eq. (6). 
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QmLi — max l q\{9) 


q-{9) = exp 


max 

Jdi(t)} 


2 V2S 
N 0 


rLT 

Jo 


r(t)di(t ) sin(cu c £ + 9)dt 


( 21 ) 


where i is the particular value of i corresponding to the data waveform d^{t) that achieves the maximiza- 
tion. Alternately, by breaking up the integration over the entire observation into a sum of integrals on 
each bit interval (the partitioned form of the observation) and recognizing that the data bits are iid binary 
random variables, then Eq. (21) evaluates to (see Fig. 1: 9ml = max^ 1 qML(9), partitioned observation) 


L - 1 

9ml 2 — max -1 TT exp 

0 A 

k = 0 


f 2 V2S 

^ No 


r(k+l)T 

JkT 


r(t) sin (u c t + 9)dt 


( 22 ) 


This estimator is analogous to Eq. (5) and is called “ML open-loop estimator no. 2.” Next, we obtain ML 
open-loop estimates by maximizing the natural logarithm of q*(9). Using the product form of q^(9) as in 
Eq. (22), one obtains (see Fig. 1: 9 ml = max^ 1 lnqML(9), partitioned observation) 


L— 1 

9ml 3 = max -1 V' 
0 ' ^ 
k=0 


2 V2S [ {k+l)T . . 

— — — / r(t) sin (oj c t + 9)dt 
^0 JkT 


(23) 


which is analogous to Eq. (6) and therefore called the “ML open-loop estimator no. 3.” Finally, we 
consider a fourth ML open-loop estimator, which is based on maximizing the natural logarithm of q-(9) 
in its unpartitioned form of Eq. (15). This leads to “ML open-loop estimator no. 4,” which is defined by 
(see Fig. 1: 9ml = max^ 1 In ^ml(^), unpartitioned observation) 


2V / 2S f LT 

9ml 4 = max 1 — — — / r(t)di(t) sin (co c t + 9)dt (24) 

6 -Wo Jo 

Block diagram implementations of ML open-loop estimator no. 1 [Eq. (21)] and ML open-loop estimator 
no. 3 [Eq. (23)] are illustrated in Fig. 5 as representative of the four possibilities. In drawing these 
implementations, we have again quantized the unknown phase into Q values and, thus, the maximization 
over the continuous phase parameter 9 in Eqs. (21) and (23) is approximated by maximization over a 
Q-quantized version of this parameter. 

As was true for the AL case, it is important to emphasize that the four ML open-loop phase estimates 
as described by Eqs. (21) through (24) are identical. However, we shall again see that this same statement 
is not true when considering the performances of the closed loops motivated by these four different ML 
formulations. 

Closed-loop phase synchronization structures based on the four ML open-loop estimators are obtained 
as analogies of their AL counterparts, choosing as error signals, e, the derivatives with respect to 9 of 
the functions being maximized in Eqs. (21) through (24), respectively. Analogous to the terminology 
used for the AL case, we shall refer to these four closed-loop structures as ML closed-loop nos. 1, 2, 3, 
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sin(av + e*) {c// (/)} 




Fig. 5. Implementation of two ML open-loop phase estimators: (a) ML open-loop estimator no. 1— observation 
unpartitioned (quantized parallel implementation) and (b) ML open-loop estimator no. 3-observation partitioned 
(quantized parallel implementation). 

and 4. An implementation of ML closed-loop no. 1 is illustrated in Fig. 6(a). We also show here in 
Fig. 6(b) an implementation of ML closed-loop no. 1 (or ML closed-loop no. 2) for the special case of 
L = 1 since, as we shall see shortly, this particular of L yields the best performance. It is worthy of note 
that ML closed-loop no. 3 is identical in form to the I-Q polarity- type Costas loop [5], as can be seen in 
Fig. 6(c). (Note that the L-fold accumulator that precedes the loop filter can be omitted since it can be 
absorbed into the loop filter itself by renormalizing its bandwidth.) We recall that, in the AL case, the 
LQ polarity-type Costas loop is obtained only as a high SNR approximation to closed-loop no. 3. 

B. Performance 

An analysis of the closed-loop performance of Fig. 6(a) results in an expression for the mean-squared 
phase error given by (see the Appendix for the derivation) 



l e LK 2 /2R d 

P 


[(1 ~ P 2 + (0)) e 2K + p 2 - (0)e 2K ] L 

{[(1 ~P+(0))e K -p_(0)e~ K ] [(1 -p+(0))e^ -j-p_(0)e-^] L-1 } 2 


A 


1 

P<Sl 


where 


(25) 


P±(<f>) = 


2 erfC 



P2±(0) — P±(<f>)\K-*2K 



Rd cos (f) ± 



(26) 
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As we did for the analogous AL closed loop [see Fig. 3(a)], we have avoided the singular behavior of 
the mean-squared phase error as R d — > oo by replacing the 2s/2S/Nq coefficient in front of the I&Ds in 
Fig. 6(a) by an arbitrary constant, say Kq, that remains finite as Nq — » 0 and further normalized the 
weighting coefficient as K — (->/ S/2)K 0 T. As long as Kq (or equivalently K) is finite (which would be 
the case in a practical implementation of the ML closed-loop scheme), the large SNR asymptotic behavior 
of ML closed-loop no. 1 is 


lim at 

R d ->oo ’ 


lim 

■No— *0 


N 0 B l 

s 


= 0 


(27) 


as one would expect. What is indeed interesting is that, unlike the AL case, the value of K that minimizes 
Eq. (25), which from the standpoint of closed - loop performance as measured by mean-squared phase error 
would be considered optimum, is not K -> 0. In fact, for each value of R d and L, there exists an optimum 
value of K that unfortunately cannot be determined in closed form. Nevertheless, the optimum values 
AT can be found numerically as a function of R d by maximizing Sp as determined from Eq. (25) for 
each value of L. The results are illustrated in Fig. 7. The corresponding values of ( S L ) max are plotted 
versus R d in dB in Fig. 8 for the same values of L as those in Fig. 7. Results obtained from a com- 
puter simulation of Fig. 6(b) agree with these analytically obtained numerical results for (S r ) m „r within 
0.1 dB at R d = -6 dB. 


From Fig. 8, we observe that the performance of ML closed- loop no. 1 becomes worse with increasing 
L, i.e., L = 1 gives the best performance. Thus, the special case of the implementation in Fig. 6(a) 
corresponding to L = 1, i.e., Fig. 6(b), is the configuration of most interest. Also in the limit as L — > oo, 
the optimum value of K approaches 0 independent of R d . The corresponding value of S L is determined 
by noting that for K -> 0 we have p+(0) = p_(0) = p 2 +(0) = p 2 -(0) = p = 1/2 erfc ^/R~ d . Then from 
Eq. (25), we get 

Hm = (<tJ) 0 = -(1 - 2 p)- 2 = - (erfc 2 ^) " -> (S L ) 0 = erfc 2 ^ (28) 

which also is independent of the observation length L. Since the optimum value of K is always greater than 
0 (see Fig. 7), Eq. (28) also serves as a lower bound on the squaring-loss performance of ML closed-loop 
no. 1. Other reasons for including this limiting squaring-loss behavior in Fig. 8 will become apparent 
shortly when we consider the other ML closed- loop configurations. 

As in the AL case, the performance of ML closed-loop no. 2 is identical to ML closed-loop no. 1 and 
needs no further discussion. Moving on to ML closed-loop no. 3, we previously identified this as being 
identical in form to the I-Q polarity-type Costas loop. Hence, its performance is independent of L and is 
given by Eq. (28). Similarly, the performance of ML closed-loop no. 4 is also independent of L and given 
by Eq. (28). Thus, we see that of the four ML closed loops, ML closed-loops nos. 1 and 2 are superior 
to ML closed-loops nos. 3 and 4, which have performances that are identical and equal to those of the 
former in the worst case ( L —► oo). 

When the performance of the best ML closed-loop scheme (i.e., nos. 1 or 2) is compared with that of 
the best AL closed-loop scheme (i.e., nos. 3 or 4), we find that the latter, e.g., the I-Q MAP estimation 
loop, is superior to the former for all values of R d . This comparison is illustrated in Fig. 9, where the 
squaring-loss performance of the two schemes is plotted versus R d . 

C. Loop S-Curves 

It is of interest to examine the S-curve behavior of ML closed-loop no. 1 and compare it with that of 
ML closed-loop no. 3 and AL closed-loop no. 3. The equation describing the loop S-curve, rj((p), of ML 


97 







closed-loop no. 1 is derived in the Appendix as Eq. (A-9) with the special case of L = 1 (already shown 
to yield the best tracking performance) given by Eq. (A-10). Figure 10 illustrates plots of ??(</>) versus 0 
over one cycle of 7 r rad for R d = -5, 2, and 5 dB, respectively, where in each case, K has been chosen 
equal to the optimum value as determined from Fig. 7. In the limit of small and large R d , the S-curve 
approaches the following functional forms: 


n((b) ex S Sin 2 sma11 R d 

' \ sin0 x sgn(cos^), larged ( 29 ) 

These limiting forms are identical to the same limiting behavior of the S-curves corresponding to ML 

closed-loop no. 3— the I-Q polarity-type Costas loop, and AL closed-loop no. 3— the I-Q MAP estimation 
loop. 

V. Conclusions 

Motivated by the theory of MAP carrier phase estimation, we have developed a number of closed-loop 
structures suitably derived from ML and AL functions. Several of these structures reduce to previously 
known closed-loop carrier phase synchronizers while others appear to be new. One of the new structures 
derived from ML considerations gives improved performance over the I-Q polarity-type Costas loop, which 
is also derived from these very same considerations. Of all the loops considered, however, the I-Q MAP 
estimation loop, which is derived from average log-likelihood considerations, is the best overall from a 
performance standpoint. We leave the reader with the thought that the structures proposed in this article 
are not exhaustive of the ways that closed-loop phase synchronizers can be derived from open-loop MAP 
estimation theory. Rather, they are given here primarily to indicate the variety of different closed-loop 
schemes that can be constructed simply from likelihood and log-likelihood functions. 



E s /N 0 .dB 

Fig. 9. A comparison of the squaring performances of ML closed-loop no. 1 or no. 2 and 
the I-Q MAP estimation loop (AL closed loop no. 3). 
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Fig. 10. Loop S-curves for ML closed-loop no. 1 or no. 2 (L = 1). 
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Appendix 

Derivation of the Closed-Loop Tracking Performance 
of ML Closed-Loop No. 1 


Consider the closed loop in Fig. 5(a), whose error signal, e(f), at time t = LT is characterized by 

eXP (^° L Sin ( Wc£ + XK ° f r (*M( £ ) cos (“ci + 0)dt (A-l) 


e = 


Substituting r(t) of Eq. (1) into Eq. (A-l) results in 


e = 


exp {a 0 /I ^ d(t)di(t)dt^J cos0 + K 0 J n(£)<^(£) sin (u c t + O^j 


K o \J~~ (j^ dfyd^dt) sin 0 + K 0 J n(£)dj (£) cos (u c t + 6) dt 


dt 


(A-2) 


In view of the rectangular phase shape assumed in Eq. (2) for the transmitted data waveform, d(t), 
Eq. (A-2) can be written in the discrete form 


= exp | K 0 d- k (^\J^d k cos 0 


J" ^ sk 


L—l 



K o d lk ^ y -d k sin 0 + n ck 


where 


A r(k+l)T r{k+l)T 

= n (t) sin (u c t + 0) dt; n ck = J n(t) cos (uj c t + 0^j dt 


W'sk 


(k+l)T 
kT 


(A-3) 


(A-4) 


are zero mean iid Gaussian random variables with variance ai — a 2 = NnT/ 4 and d = 

/ ^ • l ck 'ft'sk y / ih 

sgn\^fS/2 d k cos 0 + n sk J . Introducing the further normalization K = K 0 Ty/sj2 (note that when 
K 0 = 2 y/2S/N 0 , i.e., the gain suggested by the open-loop MAP estimation theory, then K = 2 R d ) and 
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normalizing n sk and n ck to unit variance Gaussian random variables, N sk 'and N ck , respectively, Eq. (A-4) 
becomes 


f L—l 
e = exp I K 

l k = o 


d lk 


d k cos (f) -j- 


sfi Rd 


N, k 


L ~1 , j 

K'£d tk \d k a*4 + - m 


N, , 


ck 


(A-5) 


with d ik = sgn (d k cos (f)+ (l/y/2R~i)N sk ). 

Let r](<f>) denote the signal component (mean) of the error sample e. Then, because of the independence 
of the N sk s and N ck y s, we have 


V(4>) = K sin cf>^2 d ik d k exp ^Kd ik ^ i k cos<f> + -~=N s ^j j 


N ak ' 


L~ 1 7 

n ex p 1 


x<hi 


1=0 

l^k 


d\ cos (j) + 




N s i 


■N s 


(A-6) 


where the over bar denotes statistical averaging. It is straightforward to show that the statistical averages 
required in Eq. (A-6) are independent of the data bits. That is, 


d- ik d k exp ^Kd~ ik ( d k cos <f> + 




N sk 


■N a 


is independent of whether d k — 1 or d k — — 1 and 


exp 


Kdli 


di cos 4> + 


\/2 Rd 


N s i 


■N, 


is independent of whether di = 1 or di = — 1. Performing these statistical averages gives the closed form 
results 


d l k d k exp 




d k cos 0+ —j===N sk 


N, 


= e K 2 /4R d 


[(1 - p+(</,)) e K ™*- p-(4>)e- Ka “*] 


(A-7a) 


exp ^d>i cos (f> T -~~==N 3 i^ ^ = e R2/4Rd [(1 - p+((f>)) e Kcos(t> +p_(</>)e“^ cos ^] 


(A-7b) 


where 
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P±(<t>) = 2 erfc 



Rd, cos 0 db 


) 

2 vm) 


(A-8) 


Finally, since Eq. (A-7a) is independent of k and Eq. (A- 7b) is independent of l, then substituting these 
results into Eq. (A-6), we get 


= (. Ksm(j))Le LK2/ARd [{l - p + {(j>)) e K COS(t> - p_{(f>)e~ Kcoa(t) ] 
x [(1 - p+ (0)) e K cos * + p_ (0) e -* cos *] L_1 


(A-9) 


which represents the S-curve of the loop. For L = 1, Eq. (A-9) simplifies to 


??(0) = (ATsin0)e^ 2/4i?d [(1 - p+(0)) e Kcos ^ - p_(0)e"^ cos ^] (A-10) 


which, using the definition of p ± , is periodic in 0 with period 7 r. 

The slope of the S-curve at 0 = 0 is needed for computing the closed-loop mean-squared phase error 
performance. Differentiating Eq. (A-10) with respect to 0 and evaluating the result at 0 = 0 gives 

K t = = KLe LK2/iR ‘ [(1 -p+(0))e Jfcos '*' -p_( 0) e - ,fc “'‘] 


x [(l-p + (0))e Kc ° s *+p_(0)e- Kc °^] i_1 (A-ll) 


The noise component of e evaluated at 0 = 0 is 


N 


= exp \k ^ d lk ( d k cos 0 


+ 


V%Rd 


N sk 


L - 1 




Ac=0 




JV<* 


(A-12) 


Which is zero mean and has variance 


CT " =exp { 2 ir S^( 4+ ^ fe )} 


'L - 1 


* 2 £4* 


,/c=0 


V^Rd 


N ck 


(A-13) 


Averaging first over the N ck ’s, we get 


_2 _ 
— 


a: 2 


(§ exp (* + vm N ’ k ) } 1 x S exp { 2K ( dt + vm N ’‘)} N " < A - 14 > 

l^k 

Using Eq. (A-7) to evaluate the averages over the N sk s, we get 
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(A- 15) 


a 


2 _ 

N ~ 


K 2 L 

2Rd 


e LK 2 /R d 


[(1 ~P2+(0))e 2K + p 2 -(0)e 2K ] L 


where 


P 2 ±(<f>) = P±(<P)\k^ 2 K = ^ erfc (^/R~ d cos0± 




(A-16) 


Since e(t ) is a piecewise constant (over intervals of length LT ) random process with independent 
increments, its statistical autocorrelation function is triangular and given by 


R e (r)±{E{e(t)e(t + T)}) 


* 2 n, M <lt\ 

0, otherwise J 


(A-17) 


Where (•) denotes time averaging, which is necessary because of the cyclostationarity of e(t). As is 
customary in analyses of this type, we assume a narrow-band loop, i.e., a loop bandwidth Bi , <C l/T. 
Then, e(t) is approximated as a delta-correlated process with effective power spectral density: 


K 

2 


-L 


R e (T)dT = LTo 2 N 


(A-18) 


Finally, the mean-squared phase error for the closed loop is 

2 KBl 

= -$p- (A-19) 

v 

which, with substitution of Eqs. (A-ll) and (A-18), results in Eq. (26) of the main text. 
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